Teleconference method, storage medium storing program for teleconference, and terminal apparatus

ABSTRACT

A storage medium stores: a first acquiring instruction of, when newly starting the program, acquiring conference room information for identifying a teleconference of a connection target; a determining instruction of, by referring to particular information, determining whether there is an existing conference process executed by the program that is connected to a same teleconference identified by conference room information matching the conference room information acquired by the first acquiring instruction; and an audio processing instruction of performing at least one of first and second audio processes when there is no existing conference process in a new conference process without performing either the first or second audio process when there is the existing conference process, the first audio process relating to sound collected by a sound collector of the terminal apparatus, the second audio process relating to audio data received by a communicator of the terminal apparatus connected to the network.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority from Japanese Patent Application No.2014-134286 filed Jun. 30, 2014. The entire content of the priorityapplication is incorporated herein by reference.

TECHNICAL FIELD

This disclosure relates to a terminal apparatus connected to a networkand used for a teleconference, a storage medium storing a programexecutable on a terminal apparatus, and a method of performing ateleconference.

BACKGROUND

Technology for teleconference through a network is known. For example, amultipoint image communication method is disclosed. The multipoint imagecommunication method is realized by a plurality of communicationterminal apparatuses and a multipoint connection apparatus. Eachcommunication terminal apparatus includes a plurality of televisioncameras. Each communication terminal apparatus multiplexes image signalsfrom the plurality of television cameras and transmits the image signalsto the multipoint connection apparatus. At this time, effective channelinformation is also transmitted. The multipoint connection apparatusnotifies each communication terminal apparatus about the effectivechannel information of other communication terminal apparatuses. Eachcommunication terminal apparatus selects an effective channel needed forprocessing a teleconference from the other communication terminalapparatuses and their effective channels, and inputs the effectivechannel through a display operation unit. This selection information istransmitted to the multipoint connection apparatus. In the multipointconnection apparatus, image signals of the effective channel aremultiplexed. In each communication terminal apparatus, multiplex imagesignals from the multipoint connection apparatus are separated anddisplayed on a monitor.

SUMMARY

According to one aspect, this specification discloses a teleconferencemethod executable on a terminal apparatus configured to be connected toa network and be used for a teleconference conducted through thenetwork. The method includes executing a first conference process and asecond conference process on the terminal apparatus. The firstconference process includes: transmitting video data corresponding to avideo image recorded by a first camera of the terminal apparatus to thenetwork through a communicator of the terminal apparatus connected tothe network; transmitting audio data corresponding to sound collected bya sound collector of the terminal apparatus through the communicator tothe network; and playing audio data acquired from the network throughthe communicator and outputting sound from a sound output device of theterminal apparatus. The second conference process includes: when newlyconnecting to a teleconference, acquiring conference room informationfor identifying a teleconference of a connection target; transmittingvideo data corresponding to a video image recorded by a second camera ofthe terminal apparatus through the communicator to the network; byreferring to particular information, determining whether the firstconference process is connected to a same teleconference identified byconference room information matching the conference room informationacquired when newly connecting to the teleconference; and performing atleast one of a first audio process and a second audio process when thefirst conference process is not connected to the same teleconferencewithout performing either of the first audio process and the secondaudio process when the first conference process is connected to the sameteleconference, the first audio process relating to sound collected bythe sound collector, and the second audio process relating to audio datareceived by the communicator.

According to another aspect, this specification also discloses anon-transitory computer-readable storage medium storing a programexecutable on a terminal apparatus connected to a network and used for ateleconference that is conducted through the network. The programincludes: a first acquiring instruction of, when newly starting theprogram, acquiring conference room information for identifying ateleconference of a connection target; a determining instruction of, byreferring to particular information, determining whether there is anexisting conference process executed by the program that is connected toa same teleconference identified by conference room information matchingthe conference room information acquired by the first acquiringinstruction; and an audio processing instruction of performing at leastone of a first audio process and a second audio process when there is noexisting conference process in a new conference process executed by theprogram that is newly started without performing either of the firstaudio process and the second audio process when there is the existingconference process in the new conference process, the first audioprocess relating to sound collected by a sound collector of the terminalapparatus, and the second audio process relating to audio data receivedby a communicator of the terminal apparatus connected to the network.

According to still another aspect, this specification also discloses aterminal apparatus. The terminal apparatus includes a communicator, aprocessor, and a memory storing instructions. The communicator isconfigured to connect to a network. When executed by the processor, theinstructions cause the processor to perform: transmitting video datacorresponding to a video image recorded by a first camera of theterminal apparatus through the communicator to the network; transmittingaudio data corresponding to sound collected by a sound collector of theterminal apparatus through the communicator to the network; playingaudio data acquired from the network through the communicator andoutputting sound from a sound output device of the terminal apparatus;when newly connecting to a teleconference, acquiring conference roominformation for identifying a teleconference of a connection target;transmitting video data corresponding to a video image recorded by asecond camera of the terminal apparatus through the communicator to thenetwork; by referring to particular information, determining whetherthere is an existing conference process that is connected to a sameteleconference identified by conference room information matching theconference room information acquired when newly connecting to theteleconference; and performing at least one of a first audio process anda second audio process when there is no existing conference processwithout performing either of the first audio process and the secondaudio process when there is the existing conference process, the firstaudio process relating to sound collected by the sound collector, andthe second audio process relating to audio data received by thecommunicator.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments in accordance with this disclosure will be described indetail with reference to the following figures wherein:

FIG. 1 is a diagram showing an example of a teleconference system;

FIG. 2 is a diagram showing an example of a teleconference screen;

FIG. 3 is a flowchart showing a camera starting process;

FIG. 4 is a diagram showing an example of a camera selecting screen;

FIG. 5 is a flowchart showing an audio starting process according to afirst embodiment;

FIG. 6 is a flowchart showing an audio starting process according to asecond embodiment;

FIG. 7 is a diagram showing an example of a connection target file;

FIG. 8 is a flowchart showing an audio ending process according to thesecond embodiment;

FIG. 9 is a flowchart showing an audio starting process according to athird embodiment; and

FIG. 10 is a flowchart showing an audio ending process according to thethird embodiment.

DETAILED DESCRIPTION

In a terminal apparatus operated by a user who participates in ateleconference with a teleconference counterpart who operates one or aplurality of counterpart apparatus, a teleconference program is executedwhen conducting the teleconference. A specification is conceived thatone process by this program deals with a video picture captured by onecamera out of cameras provided at the apparatus itself. In thisspecification, the inventor conceived that a plurality of teleconferenceprograms is started in one terminal apparatus having a plurality ofcameras and connects to the same teleconference. Each process afterstarting the program deals with a video picture captured by respectivecameras. In this case, in the teleconference, teleconferences processexecuted concurrently in one terminal apparatus are treated as differentconnection targets. Hence, in the above-mentioned one terminalapparatus, it is unnecessary to multiplex each video picture captured bya plurality of cameras. Accordingly, for example, even if processingpower of the terminal apparatus is not very high, a similar function tothat of the above-mentioned prior art can be obtained.

As described above, if a plurality of teleconference processes executedin one terminal apparatus connects to the same teleconference, theplurality of teleconference processes is treated as different connectiontargets. Hence, audio data transmitted by a first teleconference processis acquired and played by second and following teleconference processes.For example, after that, the user of this terminal apparatus hears hisor her own voice at delayed timing.

An example of an object of one aspect of this disclosure is to provide aterminal apparatus, a teleconference program, and a method ofteleconference that controls output and non-output of sound, in a casewhere a plurality of teleconference programs is started and a pluralityof teleconference processes is executed in one terminal apparatus.

Some aspects of the disclosure will be described while referring to theaccompanying drawings. The disclosure is not limited to configurationsdescribed below, and may adopt various configuration in the sametechnical idea. For example, a part of the configuration shown below maybe omitted or substituted with another configuration, and so on.Further, another configuration may be included.

<Teleconference System>

A teleconference system 10 will be described while referring to FIGS. 1and 2. As shown in FIG. 1, the teleconference system 10 includes aserver apparatus 20, a terminal apparatus 30, and two counterpartapparatuses 81, 82. In the following description, a teleconferenceperformed by the terminal apparatus 30 and the two counterpartapparatuses 81, 82 is described as an example. That is, it is assumedthat the terminal apparatus 30 and the counterpart apparatuses 81, 82connect to the same teleconference identified by a particular conferenceID. The teleconference by the teleconference system 10 may be performedby the terminal apparatus 30 and one counterpart apparatus, or by theterminal apparatus 30 and three or more counterpart apparatuses. Theconference ID is conference room information for identifying ateleconference performed by the terminal apparatus 30 and thecounterpart apparatuses 81, 82.

The server apparatus 20, the terminal apparatus 30, and the counterpartapparatuses 81, 82 are connected to a network 90. For example, thenetwork 90 is a network such as Internet. In the teleconference system10, a teleconference by the terminal apparatus 30 and the counterpartapparatuses 81, 82 is performed by way of the server apparatus 20. Thatis, the server apparatus 20 performs a teleconference of the terminalapparatus 30 and the counterpart apparatuses 81, 82.

The terminal apparatus 30 and the counterpart apparatuses 81, 82 arecommunication apparatuses having a communication function through thenetwork 90. The terminal apparatus 30 and the counterpart apparatuses81, 82 are communication apparatuses such as personal computers. Or, theterminal apparatus 30 and the counterpart apparatuses 81, 82 may becommunication apparatuses such as smartphones and tablet devices. Theconfiguration of the terminal apparatus 30 will be described later. Theterm “counterpart apparatus” is used merely for distinguishing thecounterpart apparatuses 81, 82 from the terminal apparatus 30, inembodiments in which the terminal apparatus 30 is described mainly. Thecounterpart apparatuses 81, 82 also perform processes and realizefunctions that are similar to those of the terminal apparatus 30described later. The descriptions for the counterpart apparatuses 81, 82are omitted appropriately. The server apparatus 20 has a hardwareconfiguration similar to that of a server apparatus in a knownteleconference system. Hence, descriptions relating to the serverapparatus 20 are omitted appropriately.

The terminal apparatus 30 receives operations targeted at URL of theserver apparatus 20. In accordance with this URL, the terminal apparatus30 accesses the server apparatus 20. This causes a teleconferenceprogram to be started. A start command for starting a teleconferenceprogram includes specifying information of an execution file, specifyinginformation of the server apparatus 20, and specifying information of aconference ID. For example, a start command is defined as“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234”. A command“ABCJoin.exe” is specifying information that specifies an executionfile. A command “Server=Japan1.ABCJoin.com” is specifying informationthat specifies the server apparatus 20. A command “Meeting=1234” isspecifying information that specifies a conference ID. When theteleconference program is started by the start command, in the terminalapparatus 30, a process by the started teleconference program becomesactive. In the embodiment, the process by the teleconference program isreferred to as “conference process”. The conference process beingexecuted by the terminal apparatus 30 becomes a state in which theconference process is connected to a teleconference identified by aconference ID executed by the server apparatus 20. That is, betweenconference processes of the server apparatus 20 and the terminalapparatus 30, video session for communication of video data and audiosession for communication of audio data are established. For example, afirst port number is assigned to the video session, and a second portnumber, which is different from the first port number, is assigned tothe audio session.

In the teleconference system 10, a plurality of teleconference programscan be started in each communication apparatus of the terminal apparatus30 and the counterpart apparatuses 81, 82. In this case, in eachcommunication apparatus, the number of conference processescorresponding to the number of started programs is executed. Forexample, assume that two cameras 42 and 54 (described later) havingdifferent shooting ranges are provided at the terminal apparatus 30. Inthe terminal apparatus 30, the teleconference program can be startedtwice so as to execute two conference processes. One of the twoconference processes corresponds to the camera 42. The other one of thetwo conference processes corresponds to the camera 54. Accordingly, ineach video session of the two conference processes, different video datacaptured by each of the cameras 42 and 54 are transmitted to the serverapparatus 20.

Although details are omitted, in a similar manner to the terminalapparatus 30, conference processes executed in each of the counterpartapparatuses 81, 82 are connected to the server apparatus 20. Betweenconference processes in each of the server apparatus 20 and thecounterpart apparatuses 81, 82, video session for communication of videodata and audio session for communication of audio data are established.As described above, in each of the counterpart apparatuses 81, 82, aswell, a plurality of teleconference programs can be started so as toexecute a plurality of conference processes at the same time.

FIG. 1 shows a configuration in which each communication apparatus ofthe terminal apparatus 30 and the counterpart apparatuses 81, 82 has twocameras. Note that the number of cameras provided at each communicationapparatus may be one or three or more. Further, the number of camerasprovided at each communication apparatus may be different numbers fromeach other.

The server apparatus 20 receives video data transmitted from eachconference process, by using video session of each conference process ineach communication apparatus of the terminal apparatus 30 and thecounterpart apparatuses 81, 82. The server apparatus 20 transmits thereceived video data to a conference process different from theconference process that is the transmission source of the received videodata. That is, the received video data is forwarded to a conferenceprocess different from the conference process of the transmissionsource, by way of the server apparatus 20. Transmission of video datafrom the server apparatus 20 is performed through video session in thisdifferent conference process.

The server apparatus 20 receives audio data transmitted from eachconference process, by using audio session of each conference process ineach communication apparatus of the terminal apparatus 30 and thecounterpart apparatuses 81, 82. The server apparatus 20 transmits thereceived audio data to a conference process different from theconference process that is the transmission source of the received audiodata. That is, the received audio data is forwarded to a conferenceprocess different from the conference process of the transmissionsource, by way of the server apparatus 20. Transmission of audio datafrom the server apparatus 20 is performed through audio session in thisdifferent conference process.

The video data is video (moving image) data of particular compressiontechnology. The compression technology is H.264, for example. The audiodata is data that is compressed by particular compression technologysuch as MPEG-4 AAC and G.411. Transmission of video data and audio datafrom the server apparatus 20 is performed by a streaming method.

In each communication apparatus of the terminal apparatus 30 and thecounterpart apparatuses 81, 82, a teleconference screen 60 is displayedfor each conference process as video data is forwarded from the serverapparatus 20. The teleconference screen 60 includes a video picture area61 and a shared material area 66 (see FIG. 2). The video picture area 61is an area for displaying video picture corresponding to video data. Ineach communication apparatus of the terminal apparatus 30 and thecounterpart apparatuses 81, 82, a CPU of each communication apparatusacquires video data from the server apparatus 20 through a communicatorof each communication apparatus. The CPU decodes and plays acquiredvideo data. The CPU outputs a display command of played video picture toa display unit of each communication apparatus. Video picture isdisplayed in the video picture area 61 in this way. In the terminalapparatus 30 and the counterpart apparatuses 81, 82, a display target inthe video picture area 61 can be set as described below.

For example, assume that two conference processes are executed in eachof the terminal apparatus 30 and the counterpart apparatuses 81, 82.Note that, in a first conference process in the terminal apparatus 30,the display target in the video picture area 61 is set as follows. Thatis, video picture captured by the camera 42 corresponding to the firstconference process in the terminal apparatus 30 is set to hidden (notdisplayed). Video picture captured by the camera 54 corresponding to asecond conference process in the terminal apparatus 30 is set to hidden(not displayed). A video picture 62 by a third conference process in thecounterpart apparatus 81 is set to display. A video picture 63 by afourth conference process in the counterpart apparatus 81 is set todisplay. A video picture 64 by a fifth conference process in thecounterpart apparatus 82 is set to display. A video picture 65 by asixth conference process in the counterpart apparatus 82 is set todisplay. In this case, in the first conference process in the terminalapparatus 30, the teleconference screen 60 shown in FIG. 2 is displayed.That is, in the teleconference screen 60, four video pictures 62, 63,64, and 65 are displayed in the video picture area 61. Video datacorresponding to video picture captured by the camera corresponding to acertain conference process is not transmitted from the server apparatus20 to that conference process. Accordingly, if video picturecorresponding to this video data is set to display, this video pictureis displayed by an internal process of this conference process. Forexample, assume that, in the terminal apparatus 30, video picturecaptured by the camera 42 is set to display in the first conferenceprocess. In this case, video picture captured by the camera 42 isdisplayed in the video picture area 61 directly, without acquisitionthrough the communicator 46.

The shared material area 66 is an area for displaying shared material67. The shared material 67 is material that is shared and used in ateleconference by the terminal apparatus 30 and the counterpartapparatuses 81, 82. A teleconference using the shared material 67 isalready realized by a known teleconference system. Hence, otherdescriptions relating this technique are omitted.

In each communication apparatus of the terminal apparatus 30 and thecounterpart apparatuses 81, 82, one of an audio starting process in afirst embodiment described later (see FIG. 5), an audio starting processin a second embodiment (see FIG. 6), an audio starting process in athird embodiment (see FIG. 9) is executed. Here, the audio startingprocess in the first embodiment is adopted, among these audio startingprocesses. In this case, as shown in FIG. 2, the teleconference screen60 includes a start button 68. The start button 68 is associated with astart command for starting a new conference process that connects to ateleconference to which a conference process corresponding to thedisplayed teleconference screen 60 is currently connected. The startcommand associated with the start button 68 includes subsidiary startupinformation, in addition to each specifying information included in theabove-described start command. The subsidiary startup information isspecifying information indicating that a newly-started conferenceprocess is not a first-time startup, that is, there is an existingconference process in the same apparatus. For example, the start commandincluding the subsidiary startup information is defined as“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234/Child”. Here,“Child” is the subsidiary startup information. The start command notincluding the subsidiary startup information(ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234) is a start commandat the first-time startup.

For example, assume that, in the terminal apparatus 30, in a state wherethe first conference process is being executed by first-time startup ofa teleconference program, a teleconference program is newly started soas to execute a second conference process. In this case, the firstconference process is executed as a result of startup of ateleconference program by a start command that does not includesubsidiary startup information. The second conference process isexecuted as a result of startup of a teleconference program by a startcommand that includes subsidiary startup information. Regarding thestart command including subsidiary startup information, informationother than the subsidiary startup information is the same as the startcommand at the first-time startup described above. Hence, otherdescriptions relating to the start command including the subsidiarystartup information are omitted. In a case where the audio startingprocess in the second embodiment or the audio starting process in thethird embodiment is adopted, the start button 68 may be omitted in theteleconference screen 60.

<Terminal Apparatus>

As shown in FIG. 1, the terminal apparatus 30 includes a CPU 32, astorage device 34, a RAM 36, a display unit 38, an operation unit 40,the camera 42, a speaker 44, the communicator 46, and a connectioninterface 48. Each of these units 32 to 48 is connected to a bus 50. Inthe embodiment, the connection interface 48 is referred to as“connection I/F 48”. A microphone 52 and the camera 54 are connected tothe connection I/F 48.

The CPU 32 executes arithmetic processes. The storage device 34 is acomputer-readable storage medium. For example, the storage device 34 isa hard disk and/or a flash memory. Also, the storage device 34 mayinclude a ROM. Various programs are stored in the storage device 34. Forexample, an OS (Operating System) and various applications are stored inthe storage device 34. The applications stored in the storage device 34include a teleconference program. The teleconference program includesprograms for executing each process shown in FIGS. 3, 5, 6, and 8-10described later. An execution file specified by the start command isalso included in the teleconference program. The program for executingeach process described later may be installed preliminarily in thestorage device 34. Or, when the terminal apparatus 30 accesses theserver apparatus 20 for connecting to a teleconference, the program maybe transmitted to the terminal apparatus 30 from the server apparatus 20through the network 90 as transmission signals and be installed in thestorage device 34 at that timing. In this case, the program may bestored in the RAM 36.

For example, the preliminary install is performed by reading a programstored in a computer-readable storage medium such as a semiconductormemory by a reader (not shown) of the terminal apparatus 30. If theterminal apparatus 30 includes an optical drive (not shown), forexample, the preliminary install may be performed by reading the programstored in an optical medium by the optical drive. Also, the preliminaryinstall may be performed by receiving the program stored in acomputer-readable storage medium such as a hard disk of a serverapparatus (the server apparatus 20 or a server apparatus not shown inthe drawings) connected to the terminal apparatus 30 through the network90, as transmission signals, by the communicator 46 of the terminalapparatus 30. Which method is adopted is determined appropriately byconsidering various conditions. Note that the computer-readable storagemedium need not include signals that are temporarily transmitted. Thecomputer-readable storage medium may be a non-transitory storage mediumthat does not include transitory signals. It is sufficient that anon-transitory storage medium store information, irrespective of a timeperiod of storing the information.

The RAM 36 is a memory area that is used when the CPU 32 executesvarious programs. The RAM 36 stores particular data and information thatare used by a process when the process is executed. In the terminalapparatus 30, the CPU 32 appropriately executes the OS and theteleconference program stored in the storage device 34, therebycontrolling the terminal apparatus 30. By this operation, in theterminal apparatus 30, for example, various processes including theabove-described first and second conference processes are executed, andvarious functions are realized. The conference process executed by theterminal apparatus 30 is identified by a process ID. The process ID isinformation for identifying a conference process.

The display unit 38 is a liquid crystal display, for example. Thedisplay unit 38 displays various kinds of information. The display unit38 displays the teleconference screen 60 and a camera selecting screen70 (see FIG. 4) described later. The operation unit 40 receives inputssuch as various instructions to the terminal apparatus 30. The operationunit 40 includes a keyboard and a mouse. Details are omitted, but aprocess that generates operational information corresponding to eachoperation to the keyboard and mouse is technology used in known personalcomputers. The terminal apparatus 30 also adopts this technology.

The camera 42 is an image capturing device that is built in the terminalapparatus 30, for example. The camera 42 captures an external image in aparticular direction of the front side of the terminal apparatus 30. Thespeaker 44 is an example of a sound output device that outputs sound.For example, sound outputted by the speaker 44 is sound corresponding toaudio data transmitted from the server apparatus 20 described above. Thecommunicator 46 connects the terminal apparatus 30 to the network 90,and performs data communication through the network 90. In the terminalapparatus 30, various data are transmitted to and received from theserver apparatus 20 through the communicator 46. For example, datatransmitted and received through the network 90 include video data andaudio data. The communicator 46 is an interface circuit that is adaptedto the Ethernet (registered trademark) standard, for example. Connectionto the network 90 by the communicator 46 may be wireless connection orwired connection.

The connection I/F 48 is an interface for connecting a particularapparatus to the terminal apparatus 30. For example, the connection I/F48 is an interface having a USB (Universal Serial Bus) port. Themicrophone 52 connected to the connection I/F 48 is an example of asound collector that collects external sound. For example, themicrophone 52 collects voices outputted by a user who operates theterminal apparatus 30. If there are two users who operate the terminalapparatus 30, the microphone 52 collects voices outputted by the twousers. The camera 54 connected to the connection I/F 48 is an imagecapturing device that is externally connected to the terminal apparatus30. The camera 54 is set to the terminal apparatus 30 in a state wherethe camera 54 captures external images from a different direction fromthe camera 42. For example, assume that there are two users who operatethe terminal apparatus 30 and who participate in the sameteleconference. The camera 42 captures an external image including oneof the two users. The camera 54 captures an external image including theother one of the two users.

The terminal apparatus 30 is different from a known communicationapparatus in that the storage device 34 or the RAM 36 stores ateleconference program including programs of each process describedlater (see FIGS. 3, 5, 6, and 8-10). However, in terms of hardware, theterminal apparatus 30 is a communication apparatus that is the same as aknown communication apparatus.

<Process Executed by Terminal Apparatus>

A camera starting process, an audio starting process, and an audioending process executed by the terminal apparatus 30 in a case where ateleconference is performed by the terminal apparatus 30 and thecounterpart apparatuses 81, 82 will be described. Regarding the audiostarting process, three examples will be described. Regarding the audioending process, an audio ending process of the second embodimentcorresponding to the audio starting process of the second embodiment,and an audio ending process of the third embodiment corresponding to theaudio starting process of the third embodiment will be described. Eachprocess in the first embodiment to the third embodiment is executed atparticular timing described later, in a conference process in responseto startup of the teleconference program by a start command. The startcommand is either one of two start commands described above. Afterstarting the teleconference program, the CPU 32 stores the start commandof this startup in the RAM 36.

<Camera Starting Process>

The camera starting process will be described while referring to FIG. 3.The camera starting process is started at the time of startup of theteleconference program. The CPU 32 having started the camera startingprocess generates the camera selecting screen 70 (S11). Next, the CPU 32controls to display the generated camera selecting screen 70 (S13). Thatis, the CPU 32 outputs a display command of the camera selecting screen70 to the display unit 38. By this operation, the camera selectingscreen 70 is displayed on the display unit 38.

As shown in FIG. 4, the camera selecting screen 70 includes a selectionarea 71, an image viewing area 72, and an OK button 73. In the selectionarea 71, a connected camera list is displayed. The connected camera listis a view (list) of cameras provided at the terminal apparatus 30. Thecameras provided at the terminal apparatus 30 are managed by the OS. Theselection area 71 is an area that receives a selection instruction forselecting one camera from among the connected camera list. For example,the CPU 32 makes an inquiry to the OS about cameras provided at theterminal apparatus 30. Then, the CPU 32 includes a view of camerasacquired from the OS in the connected camera list in the selection area71. In the embodiment, the cameras 42 and 54 are illustrated as camerasprovided at the terminal apparatus 30. Accordingly, in the selectionarea 71, the connected camera list including the cameras 42 and 54 asoptions is displayed. The selection instruction is received in responseto an operation to the selection area 71 through the operation unit 40.

The image viewing area 72 is an area that displays a video picture thatis currently shot by the camera selected by the selection area 71. Whena selection instruction is received, the CPU 32 acquires the selectioninstruction. For example, assume that selection of the camera 42 isreceived in the selection area 71. In this case, the CPU 32 acquires aselection instruction indicative of the camera 42. The CPU 32 acquires avideo picture that is currently shot from the camera 42, and controls todisplay this video picture in the image viewing area 72. The CPU 32outputs a display command of the acquired video picture to the displayunit 38. By this operation, in the display unit 38, a video picture shotby the camera 42 is displayed in the image viewing area 72 (see FIG. 4).The user of the terminal apparatus 30 can select one camera whileviewing this video picture.

The OK button 73 is a button that receives a confirmation instructionfor confirming selection of the camera selected in the selection area71. By receiving the confirmation instruction, selection of one camerais confirmed. The confirmation instruction is received in response to anoperation to the OK button 73 through the operation unit 40. When theconfirmation instruction is received, the CPU 32 acquires theconfirmation instruction.

The CPU 32 confirms the camera selected at the timing of acquisition ofthe confirmation instruction, as the camera that is used in a conferenceprocess by the teleconference program that is started this time. The CPU32 initializes the selected camera (S15). At that time, the CPU 32 setsconnection to the selected camera. This setting is managed by the OS.Next, the CPU 32 starts transmission of video data corresponding tovideo picture from the initialized camera (S17). That is, the CPU 32encodes the video picture from the initialized camera, and startsgenerating video data. The CPU 32 outputs a transmission command of thegenerated video data to the communicator 46. Then, transmission of videodata from the communicator 46 to the server apparatus 20 is started. Avideo session established in the conference process due to startup thistime is used for transmission of video data. After executing S17, theCPU 32 ends the camera starting process.

Transmission of video data started in S17 ends in response to ending ofthe conference process corresponding to startup of the teleconferenceprogram that has started the camera starting process. The conferenceprocess ends when a termination instruction of the conference process isreceived. For example, the termination instruction is received inresponse to an operation for closing the teleconference screen 60 by theconference process through the operation unit 40. The CPU 32 havingacquired the termination instruction stops generating video data in theconference process to be terminated. By this operation, transmission ofvideo data is stopped. The CPU 32 releases the camera that is set toconnection in S15. That is, the CPU 32 notifies the OS managingconnection to cameras about releasing of connection to this camera.

<Audio Starting Process of First Embodiment>

The audio starting process of the first embodiment will be describedwhile referring to FIG. 5. The audio starting process is started attiming when the terminal apparatus 30 is connected to the serverapparatus 20 and an audio session is established. The CPU 32 havingstarted the audio starting process acquires the start command that isstored in the RAM 36 when the teleconference program this time isstarted (S21). Next, the CPU 32 determines whether the start commandacquired in S21 includes subsidiary startup information (S23). Theabove-described start command will be described as an example. Assumethat the acquired start command is“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234”. In this case, theCPU 32 determines that the start command does not include subsidiarystartup information “Child” (S23: No), and advances the process to S24.Assume that the acquired start command is“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234/Child”. In thiscase, the CPU 32 determines that the start command includes subsidiarystartup information “Child” (S23: Yes), and ends the audio startingprocess. In S23, it is determined whether the startup of theteleconference program this time is a first-time startup (S23: No), oris a startup in a state where a conference process is executed (S23:Yes). In the audio starting process of the first embodiment, the startupthis time is a startup of the teleconference program by the startcommand acquired in S21.

In S24, the CPU 32 determines whether the terminal apparatus 30 canconnect to the speaker 44 and the microphone 52. For example, whenconnecting to the microphone 52, the CPU 32 performs a process ofopening a device file corresponding to a device driver of the microphone52 that is provided by the OS. If the process of opening the device filesucceeds, the CPU 32 determines that the terminal apparatus 30 canconnect to the microphone 52. On the other hand, if the process ofopening the device file fails, the CPU 32 determines that the terminalapparatus 30 cannot connect to the microphone 52. Similar processes areperformed for the speaker 44. For example, a case in which the terminalapparatus 30 cannot connect to the speaker 44 or the microphone 52 is acase in which the device file corresponding to the device driver of thespeaker 44 or the microphone 52 is opened exclusively by anotherprocess. For example, in a case where the teleconference program is setto exclusively open the device file corresponding to the device driverof the speaker 44 or the microphone 52, a fact that the terminalapparatus 30 cannot connect to the speaker 44 or the microphone 52 meansthat a conference process is currently executed. According to theprocess of S24, for example, even when a teleconference program isstarted without receiving an operation to the start button 68 (S23: No)in a state where a conference process is executed, it is possible todetermine whether the startup this time is a first-time startup (S24:Yes) or is a startup in a state where the conference process is executed(S24: No).

If the terminal apparatus 30 cannot connect to the speaker 44 or themicrophone 52 (S24: No), the CPU 32 ends the audio starting process. Ifthe terminal apparatus 30 can connect to the speaker 44 and themicrophone 52 (S24: Yes), the CPU 32 sets connection to the speaker 44(S25). This setting is managed by the OS. After that, the CPU 32 startsa sound playing process. The sound playing process is a process targetedat audio data received by the communicator 46 in an audio sessionestablished in the conference process corresponding to the startup thistime. The CPU 32 acquires audio data through the communicator 46. TheCPU 32 decodes and plays the acquired audio data. The CPU 32 controlsoutput of sound corresponding to audio data that is obtained by playing.The CPU 32 outputs an output command of sound to the speaker 44. By thisoperation, sound is outputted from the speaker 44.

Next, the CPU 32 determines whether microphone mute is set to “ON”(S27). In the teleconference system 10, for example, a conference roomsetting is preliminarily determined for each teleconference identifiedby a conference ID. The conference room setting is a setting forspecifying “ON” or “OFF” of microphone mute at the time of startup. Theconference room setting is stored in the server apparatus 20 inassociation with the conference ID. In S27, the CPU 32 controlstransmission of a conference-room-setting request. Theconference-room-setting request is a command for requesting the serverapparatus 20 to transmit a conference room setting in association withthe conference ID of a teleconference to which the conference process bythe startup this time connects. The transmission destination is set tothe server apparatus 20. The CPU 32 outputs a transmission command ofthe conference-room-setting request to the communicator 46. By thisoperation, the conference-room-setting request is transmitted from thecommunicator 46 to the server apparatus 20. In response to theconference-room-setting request, the server apparatus 20 transmits theconference room setting to the terminal apparatus 30 that has made arequest. The communicator 46 receives the conference room setting fromthe server apparatus 20. The CPU 32 acquires the conference room settingthrough the communicator 46.

If the microphone mute is set to “OFF” in the conference room setting(S27: No), the CPU 32 sets connection to the microphone 52 (S29). Thissetting is managed by the OS. After that, the CPU 32 starts a soundcollecting process. The sound collecting process is a process ofencoding sound collected by the microphone 52 and generating audio data.The CPU 32 having started the sound collecting process encodes soundcollected by the microphone 52 and generates audio data. The CPU 32controls transmission of the generated audio data. Transmission of audiodata uses the audio session established in the conference process by thestart command acquired in S21. The CPU 32 outputs a transmission commandof audio data to the communicator 46. By this operation, the audio datais transmitted from the communicator 46 to the server apparatus 20. Ifthe microphone mute is set to “ON” in the conference room setting (S27:Yes) or after S29 is executed, the CPU 32 ends the audio startingprocess.

In the audio starting process of the first embodiment, as describedabove, if the start command includes subsidiary startup information(S23: Yes), the audio starting process ends. In this case, the CPU 32does not execute S25. Accordingly, connection to the speaker 44 by theOS remains unconnected. The CPU 32 acquires, through the communicator46, audio data received by the communicator 46 in the audio sessionestablished in the conference process by the start command acquired inS21. However, the CPU 32 does not execute decoding of this audio data.If the start command includes subsidiary startup information (S23: Yes),the CPU 32 does not execute S29. Accordingly, connection to themicrophone 52 by the OS remains unconnected. In this case, sound is notcollected by the microphone 52, and audio data is not generated. Thatis, if the start command includes subsidiary startup information (S23:Yes), in the conference process by the start command acquired in S21,both of the sound playing process and the sound collecting process areunexecuted. The same goes for a case in which a negative determinationis made in S24 (S24: No).

In the audio starting process of the first embodiment, as describedabove, if the microphone mute is set to “ON” in the conference roomsetting (S27: Yes), the audio starting process ends. In this case, theCPU 32 does not execute S29. Accordingly, connection to the microphone52 by the OS remains unconnected. However, the microphone mute can bechanged to “OFF” by a particular operation through the operation unit40. When this particular operation is received by the operation unit 40,the CPU 32 sets connection to the microphone 52 as in S29, and startsthe sound collecting process.

The sound playing process started in S25 and the sound collectingprocess started in S29 end in response to termination of the conferenceprocess corresponding to the start command acquired in S21. As describedabove, the conference process ends when a termination instruction of theconference process is received. For example, the termination instructionis received in response to an operation of closing the teleconferencescreen 60 of the conference process through the operation unit 40.Assume that the conference process to be terminated was started by astart command (ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234) whichdoes not include subsidiary startup information. In this case, the CPU32 releases the speaker 44 set to connection in S25 and the microphone52 set to connection in S27 or by the above-described subsequentoperation. That is, the CPU 32 notifies the OS managing connection tothese devices about releasing of connection to the speaker 44 andreleasing of connection to the microphone 52. Assume that the conferenceprocess to be terminated was started by a start command(ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234/Child) whichincludes subsidiary startup information. In this case, neither one ofconnection to the speaker 44 and connection to the microphone 52 is set.Accordingly, releasing of connection to the speaker 44 and releasing ofconnection to the microphone 52 are skipped.

<Second Embodiment>

<Audio Starting Process>

The audio starting process of the second embodiment will be describedwhile referring to FIG. 6. In a similar manner to the above-describedaudio starting process (see FIG. 5), the audio starting process isstarted at timing when the terminal apparatus 30 is connected to theserver apparatus 20 and an audio session is established. The CPU 32having started the audio starting process acquires the start commandthat is stored in the RAM 36 when the teleconference program this timeis started (S41). Next, the CPU 32 determines whether a conference IDmatching the conference ID included in the start command acquired in S41is stored (registered) in a connection target file (S43). The connectiontarget file is a table-format file in which a conference ID identifyinga teleconference to which the terminal apparatus 30 is connected isassociated with the number of conference processes that are connected tothe teleconference identified by the conference ID (see FIG. 7). In theembodiment, the number of conference processes that are connected to theteleconference identified by the conference ID is referred to as “numberof connection”. The connection target file is stored in a particularmemory area that is secured in one of the storage device 34 and the RAM36.

The above-described start command“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234” will be describedas an example. The CPU 32 identifies the conference ID “1234” from thestart command. The CPU 32 accesses the connection target file anddetermines whether a conference ID matching the identified conference ID“1234” is stored. If the same conference ID is not stored in theconnection target file (S43: No), the CPU 32 advances the process toS45. If the same conference ID is stored in the connection target file(S43: Yes), the CPU 32 advances the process to S53. If the connectiontarget file is in a state shown in FIG. 7, the CPU 32 determines that aconference ID matching the identified conference ID “1234” is stored inthe connection target file (S43: Yes). In S43, it is determined whetherthe startup of the teleconference program this time is a first-timestartup (S43: No) or is a startup in a state where a conference processis executed (S43: Yes). In the audio starting process of the secondembodiment, the startup this time is a startup of the teleconferenceprogram by the start command acquired in S41.

In S45, the CPU 32 newly stores the conference ID identified in S43 inthe connection target file, and increments the number of connectionassociated with the stored conference ID. In this case, a number “1” isstored as the number of connection associated with the conference ID(see FIG. 7). In some cases, at timing of S45, there is no conferenceprocess, and no connection target file exists. In this case, the CPU 32creates a new connection target file.

Next, the CPU 32 sets connection to the speaker 44 (S47). This settingis managed by the OS, as described above. After that, the CPU 32 startsa sound playing process. The sound playing process is performed foraudio data received by the communicator 46 in the audio sessionestablished in the conference process. The sound playing process in S47is performed in a similar manner to the sound playing process describedin connection with S25 in FIG. 5. Accordingly, other descriptions forS47 are omitted.

Next, the CPU 32 determines whether microphone mute is set to “ON” inthe conference room setting (S49). Step S49 is executed in a similarmanner to S27 in FIG. 5. Accordingly, other descriptions for S49 areomitted. If the microphone mute is set to “OFF” in the conference roomsetting (S49: No), the CPU 32 sets connection to the microphone 52(S51). This setting is managed by the OS, as described above. Afterthat, the CPU 32 starts the sound collecting process. In the soundcollecting process, audio data is transmitted from the communicator 46through the audio session established in the conference process. Thesound collecting process in S51 is performed in a similar manner to thesound collecting process described in connection with S29 in FIG. 5.Accordingly, other descriptions for S51 are omitted. If the microphonemute is set to “ON” in the conference room setting (S49: Yes) or afterS51 is executed, the CPU 32 ends the audio starting process.

In S53, the CPU 32 increments the number of connection. The number ofconnection to be processed is the number of connection associated withthe conference ID matching the conference ID identified in S43. Forexample, assume that the conference ID identified in S43 is “1234”, andthat the connection target file is in a state shown in FIG. 7. In thiscase, the CPU 32 updates the number of connection associated with theconference ID “1234” to “2”. After that, the CPU 32 ends the audiostarting process.

In the audio starting process of the second embodiment, as describedabove, the CPU 32 does not execute S47 if a conference ID matching theconference ID included in the start command stored in the RAM 36 atstartup of the teleconference program this time is stored in theconnection target file (S43: Yes). Accordingly, connection to thespeaker 44 by the OS remains unconnected. In this case, the CPU 32 doesnot execute the sound playing process. The CPU 32 acquires, through thecommunicator 46, audio data that is received by the communicator 46 bythe audio session established in the conference process. However, theCPU 32 does not execute decoding this audio data. Similarly, if the sameconference ID is stored in the connection target file (S43: Yes), theCPU 32 does not execute S51. Accordingly, connection to the microphone52 by the OS remains unconnected. In this case, sound is not collectedby the microphone 52, and audio data is not generated. That is, if thesame conference ID is stored in the connection target file (S43: Yes),in the conference process corresponding to the start command acquired inS41, both of the sound playing process and the sound collecting processis unexecuted.

In the audio starting process of the second embodiment, as describedabove, if the microphone mute is set to “ON” in the conference roomsetting (S49: Yes), the microphone mute can be changed to “OFF” by aparticular operation through the operation unit 40. If this particularoperation is received by the operation unit 40, the CPU 32 executes asimilar process to S51.

<Audio Ending Process>

The audio ending process of the second embodiment will be describedwhile referring to FIG. 8. The audio ending process is started when atermination instruction of a conference process is received. Asdescribed above, for example, the termination instruction is received inresponse to an operation of closing the teleconference screen 60 by theconference process through the operation unit 40. The CPU 32 havingacquired the termination instruction and having started the audio endingprocess decrements the number of connection stored in the connectiontarget file (S61). The number of connection to be decremented is thenumber of connection associated with a conference ID identifying ateleconference to which the conference process to be terminated iscurrently connected. For example, the conference ID is identified asdescribed in connection with S41 and S43 of FIG. 6. For example, assumethat, when the connection target file is in a state shown in FIG. 7, aconference ID “1234” is identified from the start command“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234”. In this case, theCPU 32 accesses the connection target file, and updates the number ofconnection associated with the conference ID “1234” to “0”.

Next, the CPU 32 determines whether the number of connection afterdecrementing is “0” (S63). In the embodiment, the number of connection“0” indicates that there is no conference process. If the number ofconnection is “0” (S63: Yes), the CPU 32 releases the speaker 44 set toconnection in S47 of FIG. 6 and the microphone 52 set to connection inS51 of FIG. 6 or in the above-described subsequent operation (S65). Thatis, the CPU 32 notifies the OS managing connection to these devicesabout releasing connection to the speaker 44 and connection to themicrophone 52. If connection to the microphone 52 is not set, releasingof connection to the microphone 52 is skipped. If the number ofconnection is not “0” (S63: No) or after S65 is executed, the CPU 32ends the audio ending process. In a conference process that is thetarget of a termination instruction, in some cases, connection to thespeaker 44 or connection to the microphone 52 is not set. In this case,the CPU 32 skips executing S65 and ends the audio ending process.

<Third Embodiment>

<Audio Starting Process>

The audio starting process of the third embodiment will be describedwhile referring to FIG. 9. In a similar manner to the audio startingprocess described above (see FIGS. 5 and 6), the audio starting processis started at timing when the terminal apparatus 30 is connected to theserver apparatus 20 and an audio session is established. The CPU 32having started the audio starting process acquires the start commandthat is stored in the RAM 36 when the teleconference program this timeis started (S71). Next, the CPU 32 determines whether the same executionfile as the execution file specified by the specifying information ofthe execution file in the start command acquired in S71 is currentlyexecuted (S73). If the start command is“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234”, the execution fileis “ABCJoin.exe”. The OS manages processes that are currently executed.In S73, the CPU 32 makes an inquiry to the OS about whether there is aconference process satisfying both of the following conditions 1 and 2,and acquires a response.

Condition 1: The process ID is different from the process ID identifyingthe conference process corresponding to the start command acquired inS71

Condition 2: There is a conference process that is currently executed bythe same execution file as the execution file of the start commandacquired in S71

If there is a conference process satisfying both of the conditions 1 and2, the CPU 32 determines that an execution file of the same name iscurrently executed (S73: Yes). In this case, the CPU 32 advances theprocess to S75. If there is no conference process satisfying both of theconditions 1 and 2, the CPU 32 determines that no execution file of thesame name is currently executed (S73: No). In this case, the CPU 32advances the process to S81.

In S75, the CPU 32 acquires a conference ID. The conference ID to beacquired is a conference ID identifying a teleconference to which aconference process satisfying both of the conditions 1 and 2 isconnected. When acquiring this conference ID, the CPU 32 executesinter-process communication with the conference process satisfying bothof the conditions 1 and 2. That is, this conference ID is acquired byinter-process communication between the conference process satisfyingboth of the conditions 1 and 2 and the conference process correspondingto the start command acquired in S71. Next, the CPU 32 determineswhether the conference IDs are the same (S77). The conference IDs to bedetermined are the conference ID included in the start command acquiredin S71 and the conference ID acquired in S75. If the conference IDs arethe same (S77: Yes), the CPU 32 advances the process to S79. If theconference IDs are different (S77: No), the CPU 32 advances the processto S81.

Here, although different from the embodiment, assume that the number ofcameras provided at the terminal apparatus 30 is three or more. In thiscase, there may be two existing conference processes for which anaffirmative determination is made in S73 and that are different from theconference process by the start command acquired in S71. In S75, aconference ID is acquired from each conference process. In S77, it isdetermined whether the conference ID included in the start commandacquired in S71 and each conference ID acquired in S75 are the same. Ifthe conference ID included in the start command acquired in S71 is thesame as any one of the conference IDs acquired in S75, an affirmativedetermination is made in S77 (S77: Yes). In other words, if theconference ID included in the start command acquired in S71 is differentfrom all the conference IDs acquired in S75, a negative determination ismade in S77 (S77: No). According to S73 and S77, it is determinedwhether the startup of the teleconference program this time is afirst-time startup (see S73 or S77: No) or a startup in a state where aconference process is executed (S73 and S77: Yes).

In S79, the CPU 32 sets a subsidiary start flag to “ON” (S79). Thesubsidiary start flag “ON” indicates that the startup this time is aconference process by a startup that is not a first-time startup. In theaudio starting process of the third embodiment, the startup this time isa startup of the teleconference program corresponding to the startcommand acquired in S71. The subsidiary start flag is stored in the RAM36 in association with the process ID of the conference process by thestartup this time. After that, the CPU 32 ends the audio startingprocess.

In S81, the CPU 32 sets connection to the speaker 44. After that, theCPU 32 starts the sound playing process. Next, the CPU 32 determineswhether microphone mute in the conference room setting is set to “ON”(S83). Step S81 and the subsequent sound playing process are executed ina similar manner to S25 of FIG. 5 and S47 of FIG. 6. Step S83 isexecuted in a similar manner to S27 of FIG. 5 and S49 of FIG. 6. If themicrophone mute in the conference room setting is set to “OFF” (S83:No), the CPU 32 sets connection to the microphone 52. After that, theCPU 32 starts the sound collecting process. Step S85 and the subsequentsound collecting process are executed in a similar manner to S29 of FIG.5 and S51 of FIG. 6. Accordingly, other descriptions for steps S81 toS85 are omitted. If the microphone mute in the conference room settingis set to “ON” (S83: Yes) or after S85 is executed, the CPU 32 ends theaudio starting process.

In the audio starting process of the third embodiment, as describedabove, the CPU 32 does not execute S81 if the same execution file as theexecution file specified by the specifying information of the executionfile in the start command stored in the RAM 36 at startup of theteleconference program this time is currently executed (S73: Yes) and ifthe conference ID included in the start command acquired in S71 is thesame as the conference ID acquired in S75 (S77: Yes). Accordingly,connection to the speaker 44 by the OS remains unconnected. In thiscase, the CPU 32 does not execute the sound playing process. The CPU 32acquires audio data received through the communicator 46 by the audiosession established in the conference process. However, the CPU 32 doesnot decode this audio data. Similarly, if the execution file of the samename is currently executed (S73: Yes) and if two conference IDs are thesame (S77: Yes), the CPU 32 does not execute S85. Accordingly,connection to the microphone 52 by the OS remains unconnected. In thiscase, sound is not collected by the microphone 52, and audio data is notgenerated. That is, if the execution file of the same name is currentlyexecuted (S73: Yes) and if two conference IDs are the same (S77: Yes),in the conference process corresponding to the start command acquired inS71, both of the sound playing process and the sound collecting processare unexecuted.

If S81 is executed, the subsidiary start flag is set to “OFF”. Thesubsidiary start flag “OFF” indicates that the startup this time is aconference process by a first-time startup. If the microphone mute inthe conference room setting is set to “ON” (S83: Yes), the microphonemute can be changed to “OFF” by a particular operation through theoperation unit 40. When this particular operation is received by theoperation unit 40, the CPU 32 executes a similar process to S85.

<Audio Ending Process>

The audio ending process of the third embodiment will be described whilereferring to FIG. 10. In a similar manner to the audio ending processdescribed above (see FIG. 8), the audio ending process is started when atermination instruction of a conference process is received. Asdescribed above, for example, the termination instruction is received inresponse to an operation of closing the teleconference screen 60 by theconference process through the operation unit 40. The CPU 32 havingacquired the termination instruction and having started the audio endingprocess determines whether the subsidiary start flag associated with theprocess ID of the conference process to be terminated is “ON” (S91). Asdescribed above, the subsidiary start flag is stored in the RAM 36.

If the subsidiary start flag is “OFF” (S91: No), the CPU 32 releases thespeaker 44 set to connection in S81 of FIG. 9 and the microphone 52 setto connection in S85 of FIG. 9 or in the above-described subsequentoperation (S93). That is, the CPU 32 notifies the OS managing connectionto these devices about releasing of connection to the speaker 44 andreleasing of connection to the microphone 52. If connection to themicrophone 52 is not set, releasing of connection to the microphone 52is skipped. If the subsidiary start flag is “ON” (S91: Yes) or after S93is executed, the CPU 32 ends the audio ending process.

<Effects of Embodiments>

According to the above-described embodiments, the following effects canbe obtained.

(1) In the teleconference system 10, a plurality of teleconferenceprograms can be started in the terminal apparatus 30 that is used in ateleconference identified by a conference ID. In the terminal apparatus30, a plurality of processes based on these programs is executed. In theaudio starting process of the first embodiment shown in FIG. 5,subsidiary startup information is used, and the start command(ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234) not including thesubsidiary startup information and the start command(ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234/Child) including thesubsidiary startup information are defined. It is determined whether thestart command stored in the RAM 36 at startup of the teleconferenceprogram this time includes subsidiary startup information (S23 of FIG.5). If the subsidiary startup information is included (S23: Yes of FIG.5), neither one of connection to the speaker 44 and connection to themicrophone 52 is set (S25 and S29 of FIG. 5 are not executed). If thesubsidiary startup information is not included (S23: No of FIG. 5),connection to the speaker 44 is set (S25 of FIG. 5), and connection tothe microphone 52 is settable (S29 of FIG. 5).

In the audio starting process of the second embodiment shown in FIG. 6,the connection target file is provided (see FIG. 7). In the connectiontarget file, the conference ID identifying the teleconference to which aconference process is currently connected is stored in association withthe number of connections. It is determined whether a conference IDmatching the conference ID included in the start command stored in theRAM 36 at startup of the teleconference program this time is stored inthe connection target file (S43 of FIG. 6). If the same conference ID isstored in the connection target file (S43: Yes of FIG. 6), neither oneof connection to the speaker 44 and connection to the microphone 52 isset (S47 and S51 of FIG. 6 are not executed). If the same conference IDis not stored in the connection target file (S43: No of FIG. 6),connection to the speaker 44 is set (S47 of FIG. 6), and connection tothe microphone 52 is settable (S51 of FIG. 6).

In the audio starting process of the third embodiment shown in FIG. 9,the CPU 32 having started the audio starting process determines whetherthe same execution file as the execution file specified by thespecifying information of the execution file in the start command storedin the RAM 36 at startup of the teleconference program this time iscurrently executed (S73 of FIG. 9). This determination is negated ifthere is no conference process satisfying both of the above-describedconditions 1 and 2 (S73: No of FIG. 9), and is affirmed if there is aconference process satisfying both of the conditions 1 and 2 (S73: Yesof FIG. 9). If there is a conference process satisfying both of theconditions 1 and 2 (S73: Yes of FIG. 9), it is determined whether twoconference IDs are the same (S77 of FIG. 9). The conference IDs to bedetermined are the conference ID included in the start command acquiredin S71 and the conference ID identifying the teleconference to which theconference process satisfying both of the conditions 1 and 2 isconnected and acquired in S75. If the execution file of the same name iscurrently executed (S73: Yes of FIG. 9) and if two conference IDs arethe same (S77: Yes of FIG. 9), neither one of connection to the speaker44 and connection to the microphone 52 is set (S81 and S85 of FIG. 9 arenot executed). If the execution file of the same name is not currentlyexecuted (S73: No of FIG. 9) or if two conference IDs are different(S77: No of FIG. 9), connection to the speaker 44 is set (S81 of FIG.9), and connection to the microphone 52 is settable (S85 of FIG. 9).

Hence, in each audio starting process of the first to third embodiments,when the teleconference program this time is newly started, it can bedetermined whether there is an existing conference process that iscurrently connected to the teleconference identified by the sameconference ID. If there is a conference process and the startup of theteleconference program this time is not a first-time startup, in theterminal apparatus 30, connection to the speaker 44 is not set and thesound playing process is not executed. It is possible to prevent thesame sound from being outputted from the speaker 44 in a superimposedmanner, due to a conference process by the first-time startup and aconference process by the startup this time that is not a first-timestartup. If the startup of the teleconference program this time is not afirst-time startup, in the terminal apparatus 30, connection to themicrophone 52 is not set and the sound collecting process is notexecuted. Audio data from the conference process by the startup thistime that is not a first-time startup is not transmitted. Accordingly,the sound playing process for this audio data is not performed in theconference process by the first-time startup. It is possible to preventsound acquired by the apparatus itself from being outputted from thespeaker 44 in the terminal apparatus 30.

In the terminal apparatus 30, if the startup of the teleconferenceprogram this time is a first-time startup, both of connection to thespeaker 44 and connection to the microphone 52 are set. The soundplaying process is started, and sound is outputted from the speaker 44.The sound collecting process is started, sound is collected through themicrophone 52, and audio data corresponding to collected sound isgenerated. The generated audio data is transmitted to the serverapparatus 20.

In some cases, a plurality of conference processes is executed in eachof the counterpart apparatuses 81, 82. In this case, audio data fromeach of the counterpart apparatuses 81, 82 corresponds to one conferenceprocess that is executed in each communication apparatus. Accordingly,in the terminal apparatus 30, a situation is prevented that a pluralityof same audio data is received, and that the same sound is outputtedfrom the speaker 44 in a superimposed manner.

(2) Regarding the conference process started by the audio startingprocess of the first embodiment (see FIG. 5), when a terminationinstruction is received, releasing of connection to the speaker 44 andreleasing of connection to the microphone 52 are each controlleddepending on whether the conference process to be terminated is aprocess started by a start command not including the subsidiary startupinformation or is a process started by a start command including thesubsidiary startup information.

Regarding the conference process started by the audio starting processof the second embodiment (see FIG. 6), when a termination instruction isreceived, in the audio ending process of the second embodiment shown inFIG. 8, releasing of connection to the speaker 44 and releasing ofconnection to the microphone 52 are each controlled depending on thenumber of connections stored in the connection target file (see S63 andS65 of FIG. 8).

Regarding the conference process started by the audio starting processof the third embodiment (see FIG. 9), when a termination instruction isreceived, in the audio ending process of the third embodiment shown inFIG. 10, releasing of connection to the speaker 44 and releasing ofconnection to the microphone 52 are each controlled depending on ON orOFF of the subsidiary start flag (see S91 and S93 of FIG. 10).

Hence, depending on a usage status of the speaker 44 and/or themicrophone 52 in the conference process, releasing of connection to thespeaker 44 and releasing of connection to the microphone 52 are executedor not executed. In the terminal apparatus 30, by releasing connectionto the speaker 44 and by releasing connection to the microphone 52, thespeaker 44 and the microphone 52 can be utilized efficiently.

<Modifications>

While the disclosure has been described in detail with reference to theabove aspects thereof, it would be apparent to those skilled in the artthat various changes and modifications may be made therein withoutdeparting from the scope of the claims. In the following description,like parts and components are designated by the same reference numeralsto avoid duplicating description.

(1) In the above-described embodiment, in the camera starting processshown in FIG. 3, the camera selecting screen 70 including the connectedcamera list is created, and is displayed on the display unit 38 (see S11and S13 of FIG. 3, FIG. 4). Regarding cameras to be included in theconnected camera list, a camera used in an existing conference processmay be excluded from the connected camera list. Assume that two cameras42 and 54 are provided at the terminal apparatus 30 as in theabove-described embodiment, and that a conference process is alreadybeing executed by using the camera 42. In this case, steps Si 1 and S13may be skipped at the second-time startup of the teleconference program,and the CPU 32 may automatically select the camera 54 and execute S15and the subsequent process, as in the above-described embodiment.

(2) In the above-described embodiment,“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234” is illustrated as astart command, and a conference ID is included in the start command. Inthe audio starting process of the first embodiment,“ABCJoin.exe/Server=Japan1.ABCJoin.com/Meeting=1234/Child” isillustrated as a start command including the subsidiary startupinformation. A conference ID is included in this start command includingthe subsidiary startup information. However, a start command that doesnot include a conference ID may be used. In this case, for example, theteleconference program includes a module that displays an authenticationscreen for user authentication in response to input of the startcommand. With this configuration, in the terminal apparatus 30, when theteleconference program is started, an authentication screen (not shown)is displayed on the display unit 38. The user of the terminal apparatus30 operates the operation unit 40 and inputs an ID for authentication inthe authentication screen. The CPU 32 acquires the inputted ID forauthentication as the conference ID described above.

(3) In the above-described embodiment, in each audio starting process ofthe first to third embodiments (see FIGS. 5, 6, and 9), if there is aconference process connected to a teleconference identified by the sameconference ID at startup of the teleconference program this time and ifthe startup of the teleconference program this time is not a first-timestartup (see S23: Yes of FIG. 5, S43:Yes of FIG. 6, or S73, S77: Yes ofFIG. 9), each connection to the speaker 44 and the microphone 52 is notperformed. That is, in the audio starting process of the firstembodiment (see FIG. 5), steps S25 and S29 are not executed. In theaudio starting process of the second embodiment (see FIG. 6), steps S47and S51 are not executed. In the audio starting process of the thirdembodiment (see FIG. 9), steps S81 and S85 are not executed.

Each connection to the speaker 44 and the microphone 52 may be setregardless of whether the startup of the teleconference program thistime is a first-time startup or is not a first-time startup. In thiscase, however, the CPU 32 executes the following control. That is, theCPU 32 does not acquire, through the communicator 46, audio datareceived by the communicator 46 in the audio session established in theconference process. Thus, sound corresponding to audio data received bythe communicator 46 is not outputted from the speaker 44, as in theabove-described embodiment. The CPU 32 does not control transmission ofaudio data corresponding to sound collected by the microphone 52. Thus,even if audio data is generated, the audio data is not transmitted fromthe communicator 46 to the server apparatus 20, as in theabove-described embodiment. Or, it may be so configured that audio datais not generated. If it is not a first-time startup, in a conferenceprocess that is not a first-time startup, it may be so configured thataudio session is not established. If audio session is not established,transmission and reception of audio data are not performed. In thisconference process, the CPU 32 neither controls transmission of audiodata to the server apparatus 20, nor acquires audio data from the serverapparatus 20.

(3) In the above-described embodiment, the server apparatus 20 stores aconference room setting specifying “ON” or “OFF” of microphone mute and,in each audio starting process of the first to third embodiments (seeFIGS. 5, 6, and 9), connection to the microphone 52 is controlleddepending on “ON” or “OFF” of the microphone mute in this conferenceroom setting (see S27 and S29 of FIGS. 5, S49 and S51 of FIGS. 6, S83and S85 of FIG. 9). The microphone mute in the conference room settingmay be set to “OFF” all the time. In other words, setting of microphonemute may be omitted in the teleconference system 10. In this case, inthe audio starting process of the first embodiment, S27 of FIG. 5 isomitted. In the audio starting process of the second embodiment, S49 ofFIG. 6 is omitted. In the audio starting process of the thirdembodiment, S83 of FIG. 9 is omitted.

(4) In the above-described embodiment, in the audio ending process ofthe second embodiment (see FIG. 8), the number of connections indicatingthat there is no conference process is defined as “0” (see S63 of FIG.8). However, the number of connections indicating that there is noconference process may be defined as “1”. In this case, the CPU 32having started the audio ending process determines whether the number ofconnections associated with the conference ID identifying theteleconference to which the conference process to be terminated iscurrently connected is “1”. If the number of connections is “1”, the CPU32 decrements the number of connections associated with the conferenceID identifying the teleconference to which the conference process to beterminated is currently connected, as in S61 of FIG. 8. Next, the CPU 32executes S65 of FIG. 8. If the number of connections is larger than “1”,the CPU 32 ends the audio ending process without executing each processdescribed above, as in a case where determination in S63 of FIG. 8 isnegated (S63: No of FIG. 8).

(5) In the above-described embodiment, each audio starting process ofthe first to third embodiments (see FIGS. 5, 6, and 9) is started attiming when an audio session is established. The audio session may beestablished during each audio starting process of the first to thirdembodiments. For example, in the audio starting process of the firstembodiment, the audio session may be established when determination inS24 is negated (see S24: No of FIG. 5). In this case, S25 is executed asin the above-described embodiment after the audio session isestablished. In the audio starting process of the second embodiment, anaudio session may be established when determination in S43 is negated(see S43: No of FIG. 6). In this case, S45 is executed as in theabove-described embodiment after the audio session is established. Inthe audio starting process of the third embodiment, an audio session maybe established when determination in S73 is negated (see S73: No of FIG.9) or when determination in S77 is negated (see S77: No of FIG. 9). Inthis case, S81 is executed as in the above-described embodiment afterthe audio session is established.

(6) In the above-described embodiment, in the audio starting process ofthe first embodiment (see FIG. 5), if the start command does not includesubsidiary startup information (see S23: No of FIG. 5), it is determinedwhether the terminal apparatus 30 can connect to the speaker 44 and themicrophone 52 (see S24 of FIG. 5). However, step S24 may be omitted. Inthis case, if determination in S23 is negated (see S23: No of FIG. 5),the CPU 32 advances the process to S25. If step S24 is omitted, thestartup of the teleconference program in a state where a conferenceprocess is executed may be limited to a startup by the start button 68associated with the start command including subsidiary startupinformation.

(7) In the above-described embodiment, the teleconference system 10includes the server apparatus 20, and a teleconference executed by theteleconference system 10 is performed through the server apparatus 20.The server apparatus 20 may be omitted, and a teleconference by theterminal apparatus 30 and the counterpart apparatuses 81, 82 may be aP2P type teleconference. In the P2P type teleconference, the terminalapparatus 30 and the counterpart apparatuses 81, 82 performcommunication directly through the network 90. As a standard of the P2Ptype teleconference, WebRTC (Web Real-Time Communication) is known, forexample.

(8) In the above-described embodiment, the camera 42 and the speaker 44are built in the terminal apparatus 30, and the microphone 52 and thecamera 54 are connected to the connection I/F 48 of the terminalapparatus 30 (see FIG. 1). The camera, the speaker, and the microphonemay be provided at the terminal apparatus 30 in a different manner fromthat described above. For example, all the cameras may be connected tothe connection I/F 48. A speaker may be connected to the connection I/F48. A microphone may be built in the terminal apparatus 30.

What is claimed is:
 1. A teleconference method executable on a terminalapparatus configured to be connected to a network and be used for ateleconference conducted through the network, the method comprisingexecuting a first conference process and a second conference process onthe terminal apparatus, the first conference process comprising:transmitting video data corresponding to a video image recorded by afirst camera of the terminal apparatus to the network through acommunicator of the terminal apparatus connected to the network;transmitting audio data corresponding to sound collected by a soundcollector of the terminal apparatus through the communicator to thenetwork; and playing audio data acquired from the network through thecommunicator and outputting sound from a sound output device of theterminal apparatus, the second conference process comprising: when newlyconnecting to a teleconference, acquiring conference room informationfor identifying a teleconference of a connection target; transmittingvideo data corresponding to a video image recorded by a second camera ofthe terminal apparatus through the communicator to the network; byreferring to particular information, determining whether the firstconference process is connected to a same teleconference identified byconference room information matching the conference room informationacquired when newly connecting to the teleconference; and performing atleast one of a first audio process and a second audio process when thefirst conference process is not connected to the same teleconferencewithout performing either of the first audio process and the secondaudio process when the first conference process is connected to the sameteleconference, the first audio process relating to sound collected bythe sound collector, and the second audio process relating to audio datareceived by the communicator.
 2. A non-transitory computer-readablestorage medium storing a program executable on a terminal apparatusconnected to a network and used for a teleconference that is conductedthrough the network, the program comprising: a first acquiringinstruction of, when newly starting the program, acquiring conferenceroom information for identifying a teleconference of a connectiontarget; a determining instruction of, by referring to particularinformation, determining whether there is an existing conference processexecuted by the program that is connected to a same teleconferenceidentified by conference room information matching the conference roominformation acquired by the first acquiring instruction; and an audioprocessing instruction of performing at least one of a first audioprocess and a second audio process when there is no existing conferenceprocess in a new conference process executed by the program that isnewly started without performing either of the first audio process andthe second audio process when there is the existing conference processin the new conference process, the first audio process relating to soundcollected by a sound collector of the terminal apparatus, and the secondaudio process relating to audio data received by a communicator of theterminal apparatus connected to the network.
 3. The storage mediumaccording to claim 2, wherein the audio processing instructioncomprises: performing all of collection of sound by the sound collectoras the first audio process, transmission of audio data corresponding tothe sound collected by the sound collector through the communicator tothe network as the first audio process, acquisition of audio datareceived by the communicator as the second audio process, and playing ofthe audio data acquired through the communicator from the network as thesecond audio process when there is no existing conference processwithout performing any of collection of sound by the sound collector asthe first audio process, transmission of audio data corresponding tosound collected by the sound collector through the communicator to thenetwork as the first audio process, acquisition of audio data receivedby the communicator as the second audio process, and playing of theaudio data acquired through the communicator from the network as thesecond audio process when there is the existing conference process. 4.The storage medium according to claim 2, wherein the program furthercomprising a second acquiring instruction of acquiring a start commandfor newly starting the program, wherein the determining instructioncomprising: determining that there is the existing conference processwhen the start command of a new startup acquired by the second acquiringinstruction includes subsidiary startup information indicating that thenew startup is not a first-time startup; and determining that there isno existing conference process when the start command of the new startupacquired by the second acquiring instruction does not include thesubsidiary startup information.
 5. The storage medium according to claim2, wherein the program further comprising a third acquiring instructionof, when newly starting the program, performing inter-processcommunication between the new conference process and an earlier-startedconference process that has been connected to a teleconference, andacquiring conference room information for identifying the teleconferenceto which the earlier-started conference process has been connected, theearlier-started conference process including the existing conferenceprocess; and wherein the determining instruction comprising: determiningthat there is the existing conference process when the conference roominformation acquired by the first acquiring instruction matches theconference room information acquired by the third acquiring instruction;and determining that there is no existing conference process when theconference room information acquired by the first acquiring instructiondoes not match the conference room information acquired by the thirdacquiring instruction.
 6. The storage medium according to claim 2,wherein the program further comprising: a fourth acquiring instructionof acquiring a termination instruction for terminating the existingconference process; and a releasing instruction of, when the terminationinstruction is acquired by the fourth acquiring instruction, releasingconnection to the sound collector and releasing connection to a soundoutput device of the terminal apparatus configured to output soundcorresponding to audio data acquired through the communicator from thenetwork.
 7. The storage medium according to claim 2, wherein the programfurther comprising a storing instruction of storing, in a memory area ofthe terminal apparatus, conference room information for identifying ateleconference to which the terminal apparatus has been connected;wherein the determining instruction comprising: determining that thereis the existing conference process when the conference room informationacquired by the first acquiring instruction matches the conference roominformation stored in the memory area; and determining that there is noexisting conference process when the conference room informationacquired by the first acquiring instruction does not match theconference room information stored in the memory area.
 8. The storagemedium according to claim 7, wherein the storing instruction comprisingstoring, in the memory area, a number of connection in association withthe conference room information, the number of connection being obtainedby adding a number of the existing conference process to a number of thenew conference process.
 9. The storage medium according to claim 8,wherein the program further comprising: a fourth acquiring instructionof acquiring a termination instruction for terminating one of theexisting conference process and the new conference process; and areleasing instruction of releasing connection to the sound collector andreleasing connection to a sound output device of the terminal apparatusconfigured to output sound corresponding to audio data acquired throughthe communicator from the network; wherein the storing instructioncomprising, when the termination instruction is acquired by the fourthacquiring instruction, decrementing the number of connection stored inthe memory area and associated with the conference room informationidentifying the teleconference connected by a conference process to beterminated, out of the existing conference process and the newconference process; and wherein the releasing instruction comprisingreleasing connection to the sound collector and releasing connection tothe sound output device, when the termination instruction is acquired bythe fourth acquiring instruction and when the number of connectionstored in the memory area and associated with the conference roominformation identifying the teleconference connected by the conferenceprocess to be terminated indicates that there is neither existingconference process nor new conference process.
 10. A terminal apparatuscomprising: a communicator configured to connect to a network; aprocessor; and a memory storing instructions, the instructions, whenexecuted by the processor, causing the processor to perform:transmitting video data corresponding to a video image recorded by afirst camera of the terminal apparatus through the communicator to thenetwork; transmitting audio data corresponding to sound collected by asound collector of the terminal apparatus through the communicator tothe network; playing audio data acquired from the network through thecommunicator and outputting sound from a sound output device of theterminal apparatus; when newly connecting to a teleconference, acquiringconference room information for identifying a teleconference of aconnection target; transmitting video data corresponding to a videoimage recorded by a second camera of the terminal apparatus through thecommunicator to the network; by referring to particular information,determining whether there is an existing conference process that isconnected to a same teleconference identified by conference roominformation matching the conference room information acquired when newlyconnecting to the teleconference; and performing at least one of a firstaudio process and a second audio process when there is no existingconference process without performing either of the first audio processand the second audio process when there is the existing conferenceprocess, the first audio process relating to sound collected by thesound collector, and the second audio process relating to audio datareceived by the communicator.